AutoGCL: Automated Graph Contrastive Learning via Learnable View Generators
نویسندگان
چکیده
Contrastive learning has been widely applied to graph representation learning, where the view generators play a vital role in generating effective contrastive samples. Most of existing methods employ pre-defined generation methods, e.g., node drop or edge perturbation, which usually cannot adapt input data preserve original semantic structures well. To address this issue, we propose novel framework named Automated Graph Learning (AutoGCL) paper. Specifically, AutoGCL employs set learnable orchestrated by an auto augmentation strategy, every generator learns probability distribution graphs conditioned input. While most representative sample, policies introduce adequate variances whole procedure. Furthermore, adopts joint training strategy train generators, encoder, and classifier end-to-end manner, resulting topological heterogeneity yet similarity Extensive experiments on semi-supervised unsupervised transfer demonstrate superiority our over state-of-the-arts learning. In addition, visualization results further confirm that can deliver more compact semantically meaningful samples compared against methods. Our code is available at https://github.com/Somedaywilldo/AutoGCL.
منابع مشابه
Learning Probabilistic Submodular Diversity Models Via Noise Contrastive Estimation
Modeling diversity of sets of items is important in many applications such as product recommendation and data summarization. Probabilistic submodular models, a family of models including the determinantal point process, form a natural class of distributions, encouraging effects such as diversity, repulsion and coverage. Current models, however, are limited to small and medium number of items du...
متن کاملMultiple Structure-View Learning for Graph Classification.
Many applications involve objects containing structure and rich content information, each describing different feature aspects of the object. Graph learning and classification is a common tool for handling such objects. To date, existing graph classification has been limited to the single-graph setting with each object being represented as one graph from a single structure-view. This inherently...
متن کاملGraph Spectral Approach for Learning View Structure
In this paper we explore how to represent object viewstructure by embedding the neighbourhood graphs of feature points in a pattern-space. We adopt a graph-spectral approach. We use the leading eigenvectors of the graph adjacency matrix to define clusters of nodes. For each cluster, we compute vectors of cluster properties. We embed these vectors in a pattern-space using two contrasting approac...
متن کاملLearning Aspect Graph Representations from View Sequences
In our effort to develop a modular neural system for invariant learning and recognition of 3D objects, we introduce here a new module architecture called an aspect network constructed around adaptive axo-axo-dendritic synapses. This builds upon our existing system (Seibert & Waxman, 1989) which processes 20 shapes and classifies t.hem into view categories (i.e ., aspects) invariant to illuminat...
متن کاملOn Contrastive Divergence Learning
Maximum-likelihood (ML) learning of Markov random fields is challenging because it requires estimates of averages that have an exponential number of terms. Markov chain Monte Carlo methods typically take a long time to converge on unbiased estimates, but Hinton (2002) showed that if the Markov chain is only run for a few steps, the learning can still work well and it approximately minimizes a d...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence
سال: 2022
ISSN: ['2159-5399', '2374-3468']
DOI: https://doi.org/10.1609/aaai.v36i8.20871